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CHAPTER  I 


INTRODUCTION 

Background 

In  recent  years,  statistical  estimation  has  played  an 
ever-increasing  role  in  the  reliability  analysis  of  weapon 
systems.  Of  primary  concern  is  the  study  of  life  distribu¬ 
tions  from  which  predictions  of  system  and  component  failure 
can  be  made.  Once  failure  test  data  from  a  particular  weapon 
system  is  collected,  the  parameters  of  the  appropriate  prob¬ 
ability  model  can  be  estimated  and  the  system's  probable  life 
span  determined.  Unfortunately,  the  test  data  in  such  reli¬ 
ability  analyses  is  often  incompatible  with  the  Exponential, 
Weibull,  and  other  familiar  probability  models  (19:349).  As 
time  and  money  for  weapon  systems  development  are  placed  under 
tighter  constraints,  the  statistical  community  is  faced  with 
a  challenge  to  find  the  best  probability  models  for  particu¬ 
lar  sets  of  test  data.  It  is  also  tasked  with  finding  the 
most  efficient  techniques  of  parameter  estimation  for  specif¬ 
ic  models  (4:1) . 

This  thesis  will  focus  on  the  generalized  Gamma  dis¬ 
tribution  which  was  first  presented  by  Stacy  in  1962  (18:1187). 
This  distribution  has  since  been  recognized  and  used  as  a 
valuable  life-testing  model  (6:1601;  8:159).  With  the  modern 
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electronic  computational  capabilities  now  available,  statis¬ 
ticians  can  expand  and  modify  the  classical  methods  of  esti¬ 
mation  such  as  method  of  moments  and  maximum  likelihood.  It 
is  also  possible  to  develop  iterative  techniques,  as  well  as, 
utilize  more  recent  methods  such  as  minimum  distance  estima¬ 
tion. 

Objective 

The  objective  of  this  thesis  is  to  develop  a  robust 
estimation  procedure  which  uses  minimum  distance  estimation 
in  conjunction  with  a  modified  version  of  the  maximum  like¬ 
lihood  estimation  (MLE)  routine  developed  by  Harter  and  Moore 
(8:159-165).  This  is  an  attempt  to  find  a  faster  and  more 
accurate  iterative  technique  for  parameter  estimation  of  the 
four-parameter  generalized  Gamma  distribution.  Throughout 
the  thesis,  this  new  robust  estimation  procedure  will  be  re¬ 
ferred  to  as  the  MLDE  technique.  Estimates  from  the  MLDE 
technique  will  be  compared  with  those  obtained  from  the  orig¬ 
inal  version  of  Harter's  MLE  technique  to  evaluate  the  de¬ 
gree  to  which  the  objective  has  been  achieved.  If  the  objec¬ 
tive  is  successfully  accomplished,  the  resulting  estimation 
technique  (MLDE)  could  also  yield  improved  estimates  for  the 
guaranteed  life  of  other  distributions  being  used  as  life¬ 
testing  models.  The  MLDE  technique  could  then  be  used  to  re¬ 
duce  the  data-gathering  and  computational  costs  of  weapon 
system  life-testing  studies.  This  thesis  is  an  extension  of 
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the  work  by  Drs.  Albert  H.  Moore  and  H.  Leon  Harter  and  their 
thesis  students  in  the  field  of  parameter  estimation  (2;  4; 

7;  8;  10;  14). 
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CHAPTER  II 


POUR- PARAMETER  GENERALIZED  GAMMA  DISTRIBUTION 
Generalized  Gamma  Punction 

The  four-parameter  generalized  Gamma  probability  den¬ 
sity  function  is  defined  as 

p(x-c)  bl>"1exp{- [  (x-c)/a]p) 

f (x;c,a,b,p)  -  -  (2.1) 

abp  r(b) 

where  a,b,p^0  and  x>c>_0 

The  location  parameter  c,  also  known  as  guaranteed  life,  is 
the  value  of  x  where  the  distribution  begins  to  have  a  non¬ 
zero  value.  The  relative  scale  of  the  distribution  along  the 
x-axis  is  determined  by  a,  the  scale  parameter.  The  shape  of 
the  distribution  is  determined  by  the  shape/power  parameter  b 
and  the  power  parameter  p. 


History 

In  1962,  Stacy  presented  the  generalized  Gamma  dis¬ 
tribution  and  studied  the  properties  of  the  three-parameter 
case  (18:1187).  Later,-  Stacy  and  Mihram  made  a  further  gen¬ 
eralization  by  including  cases  in  which  the  power  parameter 
p  was  negative  (19:351).  For  the  purpose  of  this  thesis  and 
most  life  distribution  studies,  the  restrictions  of  equation 
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2.1  are  imposed  since  negative  values  of  parameters  p  and  c 
are  not  applicable  when  modeling  life  distributions.  Stacy 
and  Mihram  also  studied  some  of  the  basic  properties  of  the 
density  and  considered  parameter  estimation  by  method  of  mo¬ 
ments,  maximum  likelihood,  and  minimum  variance  with  primary 
emphasis  on  the  scale  parameter  a  (19:352-355).  Bain  and 
Weeks,  using  one  parameter  at  a  time  as  being  unknown,  devel¬ 
oped  one-sided  tolerance  limits  and  confidence  limits  (1: 

1142) .  Parr  and  Webster  obtained  expressions  for  the  maximum 
likelihood  estimators  of  the  shape/power  parameter  b  and  the 
shape  parameter  d,  where  d»bp  (16:2-3).  They  assumed  the 
generalized  Gamma  distribution  to  be  the  correct  life-testing 
model  and  provided  tests  for  rejecting  densities  such  as  the 
Weibull  and  Exponential  where  they  are  not  adequate  models 
(6:1601) .  Harter  added  a  fourth  parameter,  the  location 
parameter  c,  which  the  previous  authors  had  assumed  to  be 
zero.  With  the  addition  of  this  fourth  parameter,  he  hoped 
to  enhance  the  usefulness  of  the  generalized  Gamma  population 
in  the  study  of  life  distributions  (8:160).  Harter  formulated 
an  iterative  procedure  for  maximum  likelihood  estimation  of 
the  four-parameter  generalized  Gamma  population  using'  methods 
previously  used  for  the  three-parameter  Gamma  population.  He 
also  gave  mathematical  expressions  and  tables  for  the  asympto¬ 
tic  variances  and  covariances  of  the  maximum  likelihood  esti¬ 
mators  (7: Section  5) . 
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Four- Parameter  Generalized  Gamma  Cumulative  Distribution 


The  four-parameter  generalized  Gamma  cumulative  dis¬ 
tribution  is  given  by 

F(x)  ■  /*f (x?c,a,b, p) dx 

-  r  (b) /r(b)  (2.2) 

a) 

where  a*  »  t(x-c)/a]p  and  p>  0 

The  name  "generalized"  Gamma  is  suggested  by  the  fact  that 

/ 

the  cumulative  distribution  function  is  an  incomplete  Gamma- 
function  ratio. 

Special  cases  of  the  four-parameter  generalized 
Gamma  function  include  the  two-parameter  Exponential,  the 
three-parameter  Weibull  and  a  variety  of  other  well  known 
probability  functions.  Table  2-1  lists  some  of  these  with 
the  corresponding  notation  for  their  frequency  functions. 
Letting  the  location  parameter  c  take  on  the  value  of  zero, 
the  graphs  of  f(x;c,a,b,p)  can  take  a  variety  of  shapes 
where  P>  0.  This  can  be  seen  from  the  graphs  in  Figure  2-1 
where  changes  in  shape  are  dramatically  effected  by  varying 
the  values  of  the  product  pb  (19:352). 


TABLE  2-1 


Special  Cases  (19:351) 


TYPE  FREQUENCY  FUNCTION  RESTRICTIONS 


Exponential 

f (x;c,a,l,l) 

x>  c>  0 

a  >  0 

Gamma 

f (x;c,a,b,l) 

x>  c >  0 

a,b  >  0 

Weibull 

f (x;c,a,l,p) 

x  >  c>  0 

a,p  >  0 

Half-Normal 

f(x;c,/5,l/2,2) 

x  >  c  >  0 

Chi  Squared 

f (xjc,2»n/2,l) 

n  degrees  of 
freedom,  c  *  0 
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FIGURE  2-1 


Typical  Graphs  For  f(x;c,a,b,p)  (19:352) 


CHAPTER  III 


ESTIMATION  BY  MAXIMUM  LIKELIHOOD  METHODS 

Estimators 

Parameter  estimation  is  the  process  of  finding  ap¬ 
proximations  of  the  true  values  of  the  parameters  of  a  pro¬ 
bability  distribution.  These  approximations,  also  called 
estimates,  are  found  by  using  rules  called  estimators.  These 
rules  tell  "how  to  calculate  an  estimate  based  on  the  mea¬ 
surements  contained  in  a  sample  [12:292]."  A  sample  from  a 
four-parameter  generalized  Gamma  population  will  be  generated 
and  calculations  will  be  performed  on  the  data  according  to 
the  rules  of  the  particular  estimator  being  used.  The  results 
of  these  calculations  will  be  the  estimates  of  the  four  para¬ 
meters  of  the  four- parameter  generalized  Gamma  distribution. 
The  estimators  used  in  this  research  are  a  modified  maximum 
likelihood  estimator  (MLE)  and  a  minimum  distance  estimator 
(MLDE)  . 


Maximum  Likelihood  Estimators 

In  the  method  of  maximum  likelihood,  the  parameter 
values  which  maximize  the  likelihood  or  joint  density  of  the 
sample  are  used  as  estimates  (12:262).  Since  the  sample  is 
selected  randomly,  the  joint  density  of  the  sample  is  the 


product  of  the  probability  distribution  evaluated  at  each  of 
the  sample  points  (12:228).  For  the  four-parameter  general¬ 
ized  Gamma  density  of  n  observations,  the  likelihood  is  de¬ 
fined  by  the  formula 

L«  f (x1;c,a,brp) f (x2;c,a,b,p) • • *f (xR;c,a,b,p) 

n 

■  n  f (xtjc,a,b,p) 
i«l  1 

n  p(xi-c)bp"1exp{-[(x1-c)/alp} 

-  n - 1 - * -  o.ir 

1-1  abp  r  (b) 

To  find  the  parameters  of  the  distribution  which  maximize 
the  likelihood  function,  the  first  partial  derivatives  of  L 
with  respect  to  each  of  the  four  parameters  are  set  equal  to 
zero.  Usually  the  natural  logarithm  of  L  is  taken  before 
maximizing  as  this  transforms  the  product  into  a  sum  which 
is  easier  to  differentiate.  The  natural  logarithm  of  L  is  a 
monotonically  increasing  function  of  L  thus  both  In  L  and  L 
will  be  maximized  for  the  same  values  (12:363).  The  natural 
logarithm  of  the  likelihood  function,  the  lowest  r  and  the 
highest  (n-m)  sample  values  having  been  censored,  is  given  by 

L»Lf+1  ffl»  ln(n)t  -  ln(r)l  -  ln(n-p)l  +  (m-r)  (ln(p)-ln(a)  ] 

+  (bp-1)  z  [ln(z ,) )  -  Z  [zfl  -  (n)lnr(b) 
i»r+l  1  i«r+l  1 

+  (r)lnr(b;zp+1)  +  (n-m)ln(  r(b)-r(b;zp)  ]  (3.2) 

where  zA  »  (x^  -  c) /a 
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If  there  is  no  censoring  from  above,  the  last  term 


(n-m)lnl  r  (b)-r(b;*P)  J  (3.3) 

drops  out.  If  there  is  no  censoring  from  below,  the  next  to 
the  last  term 

(r)ln  T  (b;2P+1)  (3.4) 

drops  out. 

The  first  partial  derivatives  of  L*Lr+1  m  with  re¬ 
spect  to  a,  b,  p,  and  c  are  given  by 

3L/3a*  a'1{-bp(m-r)  +  pl[z?l  -  rzr+if  (zr+1) /Ptzr+1* 

+  (n-m)zmUzn)/ll-F(zm)]}  (3.5) 

3L/3b*  pl(ln(zi)  ]  -  nr'  (b)/r(b)  +  rr'  (b;2P+1)/r(b)  P(zr+1) 

+  (n-m)  [r '  (b)-r'  (b,*zP)]/r(b)  [1-P(zm)]  (3.6) 

3  L/3  p  *  (m-r)/p+  bZllntz^  ]  -  Kz^lnfz/)  ]  +  rf  (zr+1)  lntzr+i)/ 
pF(zr+1)-  (n-m)  f  (zra)ln(zm)/ptl-F(2ni)  1  (3.7) 

3 L/3 c  *  a_1{ (1-bp) Z [z^1]  +  pZlzP"1]  -  rf (zr+1)/F(zr+1) 

+  (n-m)f(zm)/[l-F(zm)]}  (3.8) 

where  the  primes  in  equation  (3.6)  indicate  differentiation 
with  respect  to  parameter  b  and  where 

f(z,)»p2Jp"1exp(-z?)/r(b)  ,  Ffz^  «/  *f(t)dt«  r(b;zj)/r(b) 

By  setting  the  first  partial  derivatives  of  the  likelihood 
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function  equal  to  zero,  the  maximum  likelihood  estimates  of 
the  four  parameters  a,  b,  p,  and  c  are  obtained.  In  this 
case,  the  estimator  could  not  be  solved  in  closed  form  (19: 
352) .  Solutions  can  be  found  by  iteration;  and  the  iterative 
technique  developed  by  Harter  will  be  used  to  solve  these 
equations  for  the  maximum  likelihood  estimates  (8: Section  6) . 
Throughout  this  thesis,  any  references  to  maximum  likelihood 
estimation  (MLE)  will  denote  the  use  of  Harter's  technique. 
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CHAPTER  IV 


ROBUST  MINIMUM  DISTANCE  ESTIMATION 

Robust  Estimation 

Estimation  techniques  which  are  reasonably  insensitive 
to  underlying  assumptions  were  labeled  as  having  the  quality 
of  "robustness"  by  Box  (3:318).  Much  of  the  research  in  the 
area  of  robust  estimation  was  initiated  by  the  concern  among 
the  statistical  community  that  the  classical  assumptions, 
such  as  normality,  were  sometimes  not  totally  valid  (5:30). 

One  of  the  areas  of  robust  analysis  is  the  study  of  procedures 
for  finding  robust  parameter  estimates.  A  robust  estimator 
can  adapt  to  deviations  in  the  underlying  model  and  remain 
efficient-  (17:3).  This  thesis  will  deal  with  methods  using 
estimators  which  utilize  the  information  provided  by  the  sam¬ 
ple  data  to  obtain  estimates  for  che  suspected  underlying 
model  (14:2-3). 


Minimum  Distance  Estimation 

Parr  and  Schucany  expanded  the  concept  of  robust  tech¬ 
niques  into  minimum  distance  estimation  (17) .  Most  of  the 
initial  work  in  minimum  distance  estimation  was  done  by 
Wolfowitz  in  the  early  1950's  (22:75;  21:9).  He  outlined  the 
minimum  distance  method  and  showed  it  to  be  consistent  in  a 


wide  variety  of  cases  even  when  classical  methods  failed  to 
give  consistent  estimates  (21:9).  Further  research  was  done 
by  KnUsel  in  1961#  and  by  Parr  and  Schucany  in  1979  (ll:Ch.l; 
17) .  In  1978 ,  Parr  published  an  accumulative  minimum  distance 
bibliography  covering  the  works  of  most  researchers  in  the 
field  of  minimum  distance  estimation  (15:Ch.l). 

Minimum  distance  estimation  requires  that  a  family  of 
distribution  functions  F(x;8)  be  specified.  It  also  requires 
a  rule  for  obtaining  the  empirical  distribution  function 
(EDF) ,  denoted  Sn(x) ,  which  is  merely  the  distribution  func- 
tion  of  a  particular  sample.  Finally,  it  requires  a  measure 
of  the  distance  between  F(x;6)  and  Sn(x).  Minimum  distance 
estimation  then  takes  those  values  for  the  parameter  6  which 
minimize  the  distance  between  F(x;6)  and  Sn(x) .  In  this 
thesis,  the  scale,  shape,  and  power  parameter  estimates,  pre¬ 
viously  found  by  MLE,  will  be  used  with  minimum  distance 
estimation  employing  the  Anderson-Darling  statistic  to  esti¬ 
mate  6  where  8  is  the  location  parameter  c. 

Anderson- Par ling  Statistic 

The  Anderson-Darling,  A2,  statistic  is  a  special  case 
of  the  Weighted  Cramer-von  Mises  estimator  and  takes  the  form 
00 

An(Sn'F0,"/  (Sn(x)-F0(x)]2rFg(x)  (l-Fg(x))  J^dF^Cx)  (4.1) 

(17:7-8) 

The  A2  statistic  causes  more  emphasis  to  be  placed  on  the 
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tails  of  the  distribution  and  is  noted  as  one  of  the  more 
efficient  for  estimating  the  location  parameter  (20:735). 
Stephen's  analytical  equation  for  A2  is 


A2  »  -^{^(21-1)  [ln(zi)+ln(l-2n+1-i)]/^j  -  n 
where  z^.  ■  F(xi;0)  -  P0(x1) 


(4.2) 


(20:731) 


In  the  above  equation,  z^  is  the  standardized  order  statis¬ 
tics  and  n  is  the  number  of  order  statistics. 


CHAPTER  V 


MONTE  CARLO  ANALYSIS 

Overview 

The  performance  of  the  MLE  and  MLDE  technique  is 
evaluated  by  use  of  a  Monte  Carlo  analysis.  The  Control  Data 
Corporation  (CDC)  computer  systems,  located  at  the  Aeronau¬ 
tical  Systems  Division,  Wright-Patterson  Air  Force  Base,  Ohio 
was  used  in  performing  this  analysis.  The  analysis  of  each 
technique  involves  three  distinct  steps.  First,  random  sam¬ 
ples  from  the  selected  underlying  distribution  are  generated. 
Second,  estimates  of  the  parameters  of  this  distribution  are 
found  by  using  an  estimation  technique  on  each  sample.  Third, 
these  parameter  estimates  are  compared  to  the  true  parameters 
of  the  distribution. 

Generation  of  Sample  Data 

The  comparisons  in  this  thesis  are  made  for  a  number 
of  sample  sizes  and  several  different  combinations  of  para¬ 
meter  values.  Sample  sizes  of  12,  16,  20,  and  24  are  gener¬ 
ated;  and  bhree  combinations  of  parameters  are  used  with  each 
of  these  sample  sizes.  Table  5-1  is  a  table  of  these  three 
combinations  and  their  respective  parameter  values.  For  each 
of  the  twelve  cases  (four  sample  sizes  times  three  combina- 


TABLE  5-1 

Combinations  And  Respective  Parameter  Values 


PARAMETER 

COMBINATION  1 

COMBINATION  2 

COMBINATION 

Location 

20 

30 

10 

Scale 

50 

100 

100 

Shape 

3 

2 

1 

Power 


1 


1 


2 


tions) f  1000  samples  are  generated. 

The  rejection  method  is  used  to  accomplish  the  actual 
generation  of  the  samples.  This  method  makes  use  of  the  pro¬ 
bability  density  function  rather  than  the  cumulative  distri¬ 
bution  function  (13:116).  To  use  this  method,  two  subroutines 
from  the  International  Mathematical  Statistics  Library  (IMSL) 
are  employed.  The  subroutine  GGUBS  is  used  to  generate  the 
needed  random  numbers.  Once  the  data  is  generated  by  the  re¬ 
jection  method  and  placed  in  an  array,  the  subroutine  VSRTA 
is  used  to  sort  the  array  in  ascending  order.  Specific  in¬ 
formation  about  all  IMSL  subroutines  can  be  found  in  the  IMSL 
manual  (9:Vol.l). 


Estimation  Technique  (MLDE) 

The  MLDE  technique  is  applied  to  every  case  for  each 
ordered  sample  size.  This  technique  consists  of  the  follow¬ 
ing  steps: 

1.  Initial  estimates  of  the  location,  shape,  scale, 
and  power  parameters  are  found  using  a  modified  version  of 
Harter's  MLE  technique  assuming  all  parameters  are  unknown. 
This  modified  version  relaxes  the  tolerance  limits  of  Harter's 
original  version  from  1D+07  to  1D+03. 

2.  With  the  estimates  for  the  location,  shape,  scale, 
and  power  parameters  found  in  step  1,  minimum  distance  esti¬ 
mation  using  the  A2  statistic  is  employed  to  obtain  a  new 
estimate  of  the  location  parameter. 
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3.  This  new  improved  location  parameter  estimate 
from  step  2  is  used  with  the  shape,  scale,  and  power  parameter 
estimates  from  step  1  in  the  modified  MLE  technique  in  step  1 
to  get  new  shape,  scale,  and  power  parameter  estimates. 

Estimation  Technique  (MLE) 

The  MLE  technique  is  simply  the  original  version  of 
the  iterative  technique  developed  by  Harter  to  find  maximum 
likelihood  estimates  as  described  in  Chapter  III  of  this 
thesis  (ll:Section  6). 

Comparison  of  Estimation  Techniques 

The  performance  of  the  MLE  and  the  MLDE  techniques 
will  be  determined  through  the  use  of  mean  square  error  (MSE) 
and  relative  efficiency  (REFF)  measures.  The  mean  square 
error  is  defined  as 

n  2 

MSE  -  I  I  (0.  -  0) z]/n  (5.1 ) 

i*l  1 

where  0  is  the  true  value  of  the  parameter,  0^  is  the  i-th 
estimate,  and  n  is  the  number  of  times  the  estimation  tech¬ 
nique  is  applied.  In  this  analysis,  n  is  equal  to  1000. 

When  comparing  MSE's  for  different  parameter  values,  it 
should  be  noted  that  MSEs  are  not  scale  invariant.  The  same 
size  MSE  may  be  highly  significant  for  small  value  estimates, 
but  insignificant  for  larger  ones  (2:32). 

The  relative  efficiency  is  defined  as 
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REFF  ■  MSE^/MSE j  (5.2) 

where  MSE^  is  the  mean  square  error  of  the  MLE  technique  which 
is  the  base  estimator  being  used  for  comparison  and  MSE^  is 
the  mean  square  error  of  the  MLDE  technique  which  is  the  esti~ 
mator  being  tested.  Values  greater  than  one  indicate  that  the 
MLDE  technique  is  more  efficient  than  the  MLE  technique  (10: 
23,25)  . 
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CHAPTER  VI 


RESULTS  AMD  CONCLUSIONS 

Results 

The  numerical  results  of  the  Monte  Carlo  analysis  are 
displayed  in  the  appendices.  There  are  twelve  tables  in  each 
appendix,  one  for  each  case  of  sample  sizes  and  parameter 
values.  Appendix  A  contains  tables  of  relative  efficiencies 
and  values  of  the  Anderson-Darling  statistics  for  the  two 
estimation  techniques.  Appendix  B  displays  the  average  mean 
square  errors  for  the  four  parameters.  The  most  apparent 
result  is  that  for  the  sample  sizes  analyzed  in  this  thesis, 
MLDE  yields  better  estimates  than  MLE  with  the  exception  of 
the  shape  parameter  estimates.  Use  of  the  Anderson- Darling 
statistics  resulted  in  consistent  improvement  of  the  location 
parameter  estimate  over  that  of  the  MLE  technique.  Using  this 
improved  location  parameter  estimate  and  assuming  all  other 
parameters  unknown,  the  MLDE  technique  also  produced  improved 
scale  and  power  parameters. 

The  mean  Anderson-Darling  statistic  was  used  as  a 
means  of  comparison  since  it  is  an  overall  measure  of  how  well 
the  estimator  performed.  As  seen  in  Appendix  A,  the  MLE' s 
Anderson-Darling  statistic  improves  as  the  sample  size  of 
the  particular  probability  density  function  increases.  This 


is  expected  and  is  primarily  due  to  the  fact  that  MLE  is  a 
strong  asymptotic  estimation  procedure  which  performs  better 
with  increasing  information.  As  seen  from  the  HLOE's  Ander¬ 
son-Darling  statistics,  MLDE  out  performed  MLE  for  all  cases. 
The  MLDE  technique  yielded  an  average  computer  time  savings 
of  sixteen  percent  over  that  of  Harter's  original  MLE  tech¬ 
nique.  Even  with  this  time  savings,  the  computer  runs  which 
accomplished  the  Monte  Carlo  analysis  in  this  thesis  involved 
a  total  of  180,000  seconds  of  processing  time.  In  order  to 
get  such  a  large  amount  of  computer  resources,  it  was  neces¬ 
sary  to  make  successive  runs  during  a  time  period  of  almost 
eleven  months. 


Conclusions 

The  objective  of  this  thesis  which  was  to  find  a  fast¬ 
er  and  more  accurate  iterative  technique  for  parameter  esti¬ 
mation  of  the  four-parameter  generalized  Gamma  distribution 
has  been  successfully  accomplished.  For  the  cases  analyzed 
in  this  thesis,  MLDE  provides  estimates  which  closer  fit  the 
true  distribution.  MLDE  is  not  meant  to  replace  maximum  like¬ 
lihood  techniques,  but  to  be  used  as  a  refinement  of  those 
parameter  estimates  found  by  such  techniques.  MLDE  requires 
less  time  than  the  MLE  technique  developed  by  Harter;  and  this 
savings  of  time,  and  thus  computer  resources,  could  play  an 
important  part  in  promoting  recognition  of  minimum  distance 
estimation  methods.  The  average  relative  efficiencies  fur- 
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ther  indicates  that  over  the  entire  range  of  sample  sizes  in¬ 
vestigated  in  this  thesis,  the  minimum  distance  estimation 
technique  performed  very  well  with  the  exception  of  the  shape 
parameter  estimate.  It  should  be  noted  that  the  shape  param¬ 
eter  estimate  may  appear  distorted,  however,  sometimes  this 
allows  the  overall  estimated  distribution  to  better  fit  the 
true  distribution  as  indicated  by  the  Anderson-Darling  statis¬ 
tics.  MLDE  worked  well  considering  the  sizes  of  the  samples 
and  the  fact  that  four  parameters  were  estimated  simultane¬ 
ously.  Despite  the  difficulty  in  estimating  the  shape  and 
power  parameters  simultaneously  due  to  a  high  negative  corre¬ 
lation  between  them,  minimum  distance  estimation  did  yield 
improved  parameter  estimates  when  applied  to  the  four-param¬ 
eter  generalized  Gamma  distribution  as  compared  to  those 
found  using  the  classical  MLE  estimator  (8:163). 

Recommendations 

Due  to  the  apparent  lack  of  improvement  in  the  esti¬ 
mates  of  the  shape  parameter  when  using  the  MLDE  technique, 
a  different  technique  should  be  studied  to  obtain  an  improve¬ 
ment.  One  approach  would  be  the  use  of  minimum  distance 
estimation  to  obtain  an  improved  shape  parameter  estimate  as 
was  done  with  the  location  parameter  estimate  in  this  thesis. 
This  thesis  dealt  with  sample  sizes  of  12,  16,  20,  and  24. 
Further  analysis  should  examine  larger  sample  sizes  to  see  if 
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MLDE  continues  to  perform  as  well  once  the  MLE  technique 
starts  to  yield  better  estimates  due  to  increased  information 
from  the  larger  samples. 


appendices 


25 


APPENDIX  A 

RELATIVE  EFFICIENCIES  OF  MLDE  ESTIMATES 
AND  ANDERSON- DARLING  STATISTICS 
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TABLE  A-l 


RELATIVE  EFFICIENCIES 
OF  MLDE  ESTIMATES 


Monte  Carlo 

1000 

Sample  Size 

12 

Location 

20 

Scale 

50 

Shape 

3 

Power 

1 

LOCATION  SCALE 

1.1589  1.5975 


SHAPE  POWER 

.9783  1.0798 


ANDERSON- DARLING  STATISTICS 


MLE 


MLDE 


2.5576 


1.3724 


TABLE  A- 2 


RELATIVE  EFFICIENCIES 
OF  MLDE  ESTIMATES 


Monte  Carlo 

1000 

Sample  Size 

16 

Location 

20 

Scale 

50 

Shape 

3 

Power 

1 

LOCATION  SCALE  SHAPE 

1.2176  1.0375  1.3148 


POWER 

1.1358 


ANDERSON- DARLING  STATISTICS 


MLE 


MLDE 


1.7192 


4526 


TABLE  A- 3 

RELATIVE  EFFICIENCIES 
OF  MLDE  ESTIMATES 


Monte  Carlo 

1000 

Sample  Size 

20 

Location 

20 

Scale 

50 

Shape 

3 

Power 

1 

LOCATION 

SCALE 

SHAPE 

POWER 

1.1068 

1.0873 

1.0030 

1.0897 

ANDERSON- DARLING 

STATISTICS 

MLE 

MLDE 

8026 


2687 


TABLE  A- 4 


RELATIVE  EFFICIENCIES 
OF  MLDE  ESTIMATES 


Monte  Carlo 

1000 

Sample  Size 

24 

Location 

20 

Scale 

50 

Shape 

3 

Power 

1 

LOCATION  SCALE 

1.1165  1.1046 


SHAPE  POWER 

.9770  1.1167 


ANDERSON- DARLING  STATISTICS 


i 

i' 

i 


MLE 


MLDE 


7044 


2636 


TABLE  A- 5 


RELATIVE  EFFICIENCIES 
OF  MLDE  ESTIMATES 


Monte  Carlo 

1000 

Sample  Size 

12 

Location 

30 

Scale 

100 

Shape 

2 

Power 

1 

LOCATION  SCALE 

1.2786  1.0006 


SHAPE  POWER 

.7145  1.1594 


ANDERSON- DARLING  STATISTICS 


MLE 


MLDE 


2.5996 


1.2705 


r 


TABLE  A- 6 

RELATIVE  EFFICIENCIES 
OF  MLDE  ESTIMATES 


Monte  Carlo 

1000 

Sample  Size 

16 

Location 

30 

Scale 

100 

Shape 

2 

Power 

1 

LOCATION  SCALE 

1.1999  1.0012 


SHAPE  POWER 

.8902  1.1549 


ANDERSON- DARLING  STATISTICS 


MLE 


MLDE 


1.0608 


3792 


TABLE  A- 7 


RELATIVE  EFFICIENCIES 
OF  MLOE  ESTIMATES 


Monte  Carlo 

1000 

Sample  Size 

20 

Location 

30 

Scale 

100 

Shape 

2 

Power 

1 

LOCATION 

SCALE 

SHAPE 

POWER 

«  • 

! 1 

1.3411 

1.0043 

.8071 

1.1657 

«» 

if 

i 


ANDERSON- DARLING  STATISTICS 


MLDE 

.3218 


* 

33 


MLE 

.9830 


TABLE  A- 8 


RELATIVE  EFFICIENCIES 
OF  MLDE  ESTIMATES 


Monte  Carlo 

1000 

Sample  Size 

24 

Location 

30 

Scale 

100 

Shape 

2 

Power 

1 

LOCATION  SCALE  SHAPE  POWER 

1.1390  1.0785  .9687  1.0984 


ANDERSON- DARLING  STATISTIC 


MLE  MLDE 

.6119  .2781 


T 


TABLE  A-10 


RELATIVE  EFFICIENCIES 
OF  MLDE  ESTIMATES 


Monte  Carlo 

1000 

Sample  Size 

16 

Location 

10 

Scale 

100 

Shape 

1 

Power 

2 

LOCATION  SCALE 

1.1122  .9437 


SHAPE  POWER 

.9148  1.0913 


ANDERSON- DARLING  STATISTICS 


MLE 


MLDE 


8855 


3111 


TABLE  A- 11 


RELATIVE  EFFICIENCIES 
OF  MLDE  ESTIMATES 


Monte  Carlo 

1000 

Sample  Size 

20 

Location 

10 

Scale 

100 

Shape 

1 

Power 

2 

LOCATION 

SCALE 

SHAPE 

POWER 

1.0978 

1.0001 

.9945 

1.0954 

ANDERSON- DARLING 

STATISTICS 

MLE 

MLDE 

.5592 

.2869 

*. 
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T 


TABLE  A' 12 


RELATIVE  EFFICIENCIES 
OF  MLDE  ESTIMATES 


Monte  Carlo 

1000 

Sample  Size 

24 

Location 

10 

Scale 

100 

Shape 

1 

Power 

2 

LOCATION  SCALE 

1.0915  1.0459 


SHAPE  POWER 

1.3357  1.1125 


ANDERSON- DARLING  STATISTICS 


MLE 


MLDE 


5407 


2711 
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AVERAGE  MEAN  SQUARE  ERRORS 
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TABLE  B-l 


AVERAGE  MEAN  SQUARE  ERRORS 


Monte  Carlo  1000 
Sample  Size  12 
Location  20 
Scale  50 
Shape  3 
Power  1 


TABLE  B-2 


AVERAGE  MEAN  SQUARE  ERRORS 


Monte  Carlo  1000 
Sample  Size  16 
Location  20 
Scale  50 
Shape  3 
Power  1 


PARAMETER 


MLE 


MLDE 


LOCATION 

SCALE 

SHAPE 


1035.16 

8827.35 

3.28562 


850.170 

8508.45 

2.49892 


POWER 


345935 


304579 


TABLE  B-3 


AVERAGE  MEAN  SQUARE  ERRORS 


Monte  Carlo  1000 
Sample  Size  20 
Location  20 
Scale  50 
Shape  3 
Power  1 


PARAMETER 


MLE 


MLDE 


LOCATION 

SCALE 

SHAPE 

POWER 


1335.52 

26389.0 

23.1567 

10.0422 


1206.65 

24268.5 

23.0870 

9.21519 


i 
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TABLE  B-4 

AVERAGE  MEAN  SQUARE 

ERRORS 

Monte  Carlo 

1000 

Sample  Size 

24 

Location 

20 

Scale 

50 

LOCATION 

1083.81 

970.706 

SCALE 

25589.4 

23167.1 

SHAPE 

17.1962 

17.6006 

POWER 

8.61239 

7.71263 

TABLE  B-5 

AVERAGE  MEAN  SQUARE  ERRORS 


Monte  Carlo  1000 
Sample  Size  12 
Location  30 
Scale  100 
Shape  2 
Power  1 


PARAMETER 


MLE 


MLDE 


LOCATION 

SCALE 

SHAPE 


1736.82 

6896990 

4.42252 


1358.38 

6893010 

6.18980 


POWER 


6.82063 


5.88276 


TABLE  B-6 


AVERAGE  MEAN  SQUARE  ERRORS 


Monte  Carlo  1000 
Sample  Size  16 
Location  30 
Scale  100 
Shape  2 
Power  1 


PARAMETER 

MLE 

MLDE 

LOCATION 

SCALE 

SHAPE 

POWER 


1339.57 

2980210 

9.59494 

8.41545 


1116.44 

2976620 

10.7790 

7.28639 


TABLE  B-8 

AVERAGE  MEAN  SQUARE 

ERRORS 

Monte  Carlo 

1000 

Sample  Size 

24 

Location 

30 

Scale 

100 

Shape 

2 

Power 

1 

PARAMETER 

MLE 

MLDE 

LOCATION 

SCALE 

SHAPE 


942.403 

48180.3 

3.57009 


.827.419 

44672.5 

3.68541 


POWER 


11.2675 


10.2577 


TABLE  B-9 

AVERAGE  MEAN  SQUARE  ERRORS 


Monte  Carlo  1000 
Sample  Size  12 
Location  10 
Scale  100 
Shape  1 
Power  2 


PARAMETER 


MLE 


MLDE 


LOCATION 

SCALE 

SHAPE 


621.546 

4903050 

2.88021 


542.614 

2943140 

8.46044 


POWER 


7.69565 


5.96874 


TABLE  B-l 

AVERAGE  MEAN  SQUA1 

Monte  Carlo 

Sample  Size 

Location 

Scale 

Shape 

Power 


PARAMETER 


MLE 


LOCATION 

SCALE 

SHAPE 


509.463 

2321.95 

7.91291 


POWER 


8.80151 


ERRORS 

1000 

16 

10 

100 

1 

2 


MLDE 


458.052 

2460.50 

8.64999 


8.06528 


TABLE  B-ll 


AVERAGE  MEAN  SQUARE  ERRORS 


Monte  Carlo  1000 
Sample  Size  20 
Location  10 
Scale  100 
Shape  1 
Power  2 


PARAMETER 


MLE 


MLDE 


LOCATION 

SCALE 

SHAPE 

POWER 


286.557 

1741.65 

1.45520 

12.4612 


261.030 

1741.40 

I. 46331 

II. 3761 


50 


TABLE  B-12 


AVERAGE  MEAN  SQUARE  ERRORS 


Monte  Carlo 

Sample  Size 

Location 

Scale 

Shape 

Power 


1000 

24 

10 

100 

1 

2 


PARAMETER 

MLE 

MLDE 

LOCATION 

300.712 

275.501 

SCALE 

2108.66 

2016.02 

SHAPE 

110.632 

82.8294 

POWER 

12.6957 

11.4117 
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